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Abstract 

The constraint satisfaction problem (CSP) is a central generic problem in computer science and 
artificial intelligence: it provides a common framework for many theoretical problems as well as for many 
real-life applications. Soft constraint problems are a generalisation of the CSP which allow the user to 
model optimisation problems. Considerable effort has been made in identifying properties which ensure 
tractability in such problems. In this work, we initiate the study of hybrid tractability of soft constraint 
problems; that is, properties which guarantee tractability of the given soft constraint problem, but which 
do not depend only on the underlying structure of the instance (such as being tree-structured) or only 
on the types of soft constraints in the instance (such as submodularity). We present several novel hybrid 
classes of soft constraint problems, which include a machine scheduling problem, constraint problems of 
arbitrary arities with no overlapping nogoods, and the SoftAllDiff constraint with arbitrary unary soft 
constraints. An important tool in our investigation will be the notion of forbidden substructures. 

Keywords: Constraint optimisation; Computational complexity; Tractability; Soft constraints; Valued con- 
straint satisfaction problems; Graphical models; Forbidden substructures. 

1 Introduction 

An instance of the constraint satisfaction problem (CSP) consists of a collection of variables which must 
be assigned values subject to specified constraints. Each CSP instance has an underlying undirected graph, 
known as its constraint network, whose vertices are the variables of the instance, and two vertices are adjacent 
if corresponding variables are related by some constraint. Such a graph is also known as the structure of the 
instance. 

An important line of research on the CSP is to identify all tractable cases which are recognisable in 
polynomial time. Most of this work has been focused on one of the two general approaches: either identifying 
forms of constraint which are sufficiently restrictive to ensure tractability no matter how they are combined [ , 
] , or else identifying structural properties of constraint networks which ensure tractability no matter what 
forms of constraint are imposed [3]. 

The first approach has led to identifying certain algebraic properties known as polymorphisms [ ] which 
are necessary for a set of constraint types to ensure tractability. A set of constraint types which ensures 
tractability is called a tractable constraint language. The second approach has been used to characterise all 
tractable cases of bounded-arity CSPs (such as binary CSPs): the only class of structures which ensures 
tractability (subject to certain complexity theory assumptions) are structures of bounded tree-width [5, 6]. 

In practice, constraint satisfaction problems usually do not possess a sufficiently restricted structure or 
use a sufficiently restricted constraint language to fall into any of these tractable classes. Nevertheless, they 
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may still have properties which ensure they can be solved efficiently, but these properties concern both the 
structure and the form of the constraints. Such properties have sometimes been called hybrid reasons for 
tractability [7, 8, 9, 10, 11]. 

Since in practice many constraint satisfaction problems are over-constrained, and hence have no solution, 
or are under-constrained, and hence have many solutions, soft constraint satisfaction problems have been 
studied [ ] . In an instance of the soft CSP, every constraint is associated with a function (rather than a relation 
as in the CSP) which represents preferences among different partial assignments, and the goal is to find the 
best assignment. Several very general soft CSP frameworks have been proposed in the literature [12, 13]. 
In this paper we focus on one of the very general frameworks, the valued constraint satisfaction problem 
(VCSP) [12]. 

Similarly to the CSP, an important line of research on the VCSP is to identify tractable cases which are 
recognisable in polynomial time. Is is well known that structural reasons for tractability generalise to the 
VCSP [ ]. In the case of language restrictions, only a few conditions are known to guarantee tractability of 
a given set of valued constraints [14, 15]. 

Up until now there have been very few results on hybrid tractability for the VCSP. For instance, Kumar 
defines an interesting framework for hybrid tractability for the Boolean weighted CSP [10]. However, to the 
best of our knowledge, this framework has so far not provided any new hybrid classes. In fact, all tractable 
classes presented in [10] are not hybrid and are already known. 

Contributions The main contribution of the paper is the systematic study of hybrid tractability of VCSPs 
and the introduction of several novel hybrid tractable classes of VCSPs. As a first step, we start with binary 
VCSPs. 

First, we will demonstrate three hybrid classes defined by forbidding certain graphs as induced subgraphs 
in the structure of the VCSP instance. 1 However, the tractable classes described in this part of the paper are 
not entirely satisfactory as a first step towards a general theory of hybrid tractable classes of VCSP instances, 
since the only soft constraints they allow are unary and, furthermore, classical graph theory does not even 
allow us to express all possible classes of such instances. 

Second, we introduce classes of CSPs with polynomially many solutions and polynomially many dead 
ends in the search tree. We also discuss tractable extensions of these two classes to VCSPs. Furthermore, 
we show that the recently introduced hybrid class of CSPs satisfying the broken-triangle property [11] is not 
extendible to VCSPs with soft unary constraints. 

Finally, as arguably the most interesting hybrid class in this paper, we introduce the class defined by the 
joint-winner property (JWP). This class generalises the SoftAllDiff constraint with arbitrary unary soft 
constraints. Moreover, this class can be generalised to a larger class of non-binary VCSPs which includes 
CSP instances with no overlapping nogoods. 

A preliminary version of part of this work appeared as a conference paper [16]. This paper is a significant 
extension of the previous work [16] since it includes: an extended Section 3 (VCSPs with crisp binary 
constraints), new hybrid tractable classes (based on polynomially many solutions and dead ends, described 
in Section 4), an improved complexity analysis of the algorithm solving VCSP instances satisfying the JWP 
in Section 5.3, a complete proof of maximality of the JWP in Section 5.4 ([16] considered only a special 
case), and an extension of the JWP in Section 5.5. Moreover, the preliminary conference version [16] did not 
consider the Z-free property, discussed in Section 5.2, which is necessary for the complete proof of tractability 
of VCSPs satisfying the JWP. 

The rest of the paper is organised as follows. In Section 2, we define binary constraint satisfaction problems 
(CSPs), valued constraint satisfaction problems (VCSPs) and other necessary definitions needed throughout 
the paper. In Section 3, we study binary VCSPs whose only soft constraints are unary. Using a connection 
between these VCSPs and the maximum weight independent set problem in certain graph classes, we identify 
hybrid tractable classes of VCSPs. In Section 4, we present a novel class of tractable CSPs based on CSPs 
with polynomially many dead ends in the search tree. Furthermore, we present a class of tractable CSPs with 
polynomially many solutions. We discuss tractable extensions of these two classes to VCSPs. In Section 5, 

1 More precisely, in the micro- structure complement of the instance (defined in Section 2). 
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we define the joint-winner property. In Section 5.1, we give several examples of studied problems that satisfy 
the joint-winner property. In Section 5.2, we study important properties of VCSP instances satisfying the 
joint-winner property, which allow us, in Section 5.3, to present a polynomial-time algorithm for solving 
binary VCSPs satisfying the joint-winner property. In Section 5.4, we prove that this new tractable class 
is maximal. In Section 5.5, we extend the class of tractable VCSPs defined by the joint-winner property. 
Finally, in Section 6, we summarise our work and finish with some open problems. 

We remark that even though our results are formulated as soft constraint satisfaction problems, it is 
clear that these results apply to various other optimisation frameworks that are equivalent to soft constraint 
problems such as Gibbs energy minimisation, Markov Random Fields and other graphical models [17, 18]. 

2 Preliminaries 

In this paper we focus on binary valued constraint satisfaction problems. We denote by Q + the set of all 
non-negative rational numbers. We denote Q + = Q + U {oo} with the standard addition operation extended 
so that for all a € Q +) a + oo = oo. Members of Q + are called costs. 

A unary cost function over domain Di is a mapping Cj : Di — > Q + . A binary cost function over domains 
A and Da is a mapping aj : Di x Dj — > Q_|_. If the range of Cj (c%j respectively) lies entirely within Q+, 
then Ci (cij respectively) is called a finite-valued cost function. 

If the range of Ci (cy respectively) is {a, oo}, for some a £ Q+, then Cj (cy respectively) is called a crisp 
cost function. Note that crisp cost functions are just relations; that is, subsets of Di (in the unary case) or 
Di x Dj (in the binary case) corresponding to the set of finite-cost tuples. If Ci (c^ respectively) is not a 
crisp cost function, it is called soft. 

A binary VCSP instance [12] consists of a set of variables (denoted as Vi, where i e {1, . . . ,n}); for each 
variable Vi a domain Di containing possible values for variable Vf, and a set of valued constraints. Each valued 
constraint is either of the form (uj, Cj), where Vi is a variable and Cj is a unary cost function (constraints of this 
form are called unary constraints), or of the form ((vi, Vj), c^), where Vi and Vj are variables, the pair (vi, Vj) 
is called the scope of the constraint, and is a binary cost function (constraints of this form are called binary 
constraints). A constraint is called crisp if its associated cost function is crisp, and similarly a constraint is 
called soft if its associated cost function is soft. For notational convenience, throughout this paper we assume 
that there is a unique valued constraint on any given scope. In particular, Cij(a, b) = Cji(b, a), since they are 
simply two different ways of representing the unique cost of simultaneously assigning (a, b) to variables (i, j) . 

A solution to a VCSP instance is an assignment of values from the domains to the variables with the 
minimum total cost given by 



A VCSP instance with only crisp constraints is called a CSP instance. In the CSP, the task of finding an 
optimal solution amounts to deciding whether there is a solution with finite cost (all constraints are satisfied) . 

The micro-structure of a binary CSP instance V is a graph where the set of vertices corresponds to the set 
of possible assignments of values to variables: a vertex (vi,a) represents the assignment of value a to variable 
Vi [19]. The edges of the micro-structure connect all pairs of variable- value assignments that are allowed by 
the constraints. (Note that if there is no explicit constraint between two variables, then it is considered to be 
the complete constraint allowing all pairs of assignments.) The micro-structure of a binary VCSP instance is 
defined similarly, but both vertices and edges of the graph are assigned costs. For CSPs, the micro- structure 
complement is the complement of the micro-structure: its edges represent pairs of variable- value assignments 
that are disallowed by the constraints. Hence for every variable v^, the micro-structure complement contains 
all edges of the form {(vi, a), (vi, b)} for a ^ b G Di as every variable can be assigned only one value. 

A clique in a graph is a set of vertices which are pairwise adjacent. An independent set in a graph is a 
set of vertices which are pairwise non-adjacent. It is well known that solving a CSP instance V is equivalent 
to finding a clique of size n in the micro-structure of V, and to finding an independent set of size n in 
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the micro-structure complement of V [ ]. Therefore, tractability results on the maximum independent set 
problem for various classes of graphs can be straightforwardly used to obtain tractable CSP classes [8, 20]. 

Given a graph G, we denote by V(G) the set of vertices of G and by E(G) the set of edges of G. A 
coloured graph Q = (G,cg) is a graph G and a colouring cq ■ V(G) — > {1, . . . ,n} of the vertices of G. The 
coloured micro- structure (complement) of an n- variable binary CSP instance V is Q — (G, cq) where G is the 
micro-structure (complement) of V and cq is a colouring cq : V(G) —> {1, . . . ,n} of the vertices of G, such 
that the colour of vertex (vi, a) is i. Unlike the micro-structure, the coloured micro-structure contains all the 
information necessary to reconstruct the original instance V . 

A graph H is an induced subgraph of G if there is an injective mapping / : V(H) — > V(G) such that 
(u,v) G E(H) if, and only if, (f(u),f(v)) G E(G). We now extend the notion of induced subgraphs to 
that of induced and forbidden substructures of the coloured micro-structure and coloured micro-structure 
complement. Let Q — (G, cq) be the coloured micro-structure or coloured micro-structure complement of 
a CSP instance V . Now let % = (H, ch) be a coloured graph. We say that % is an induced substructure 
of Q if H is an induced subgraph of G and vertices of the same colour are mapped to vertices of the same 
colour; that is, if there is an injective mapping / : V(H) — > V(G) such that (1) (u,v) G E(H) if and only 
if (f(u),f(v)) G E(G); and (2) ch{u) — cr{v) if and only if cg(/(u)) = cc(f(v)). Throughout the paper 
we will present several classes of VCSPs that will be defined by forbidding a certain substructure (called 
a pattern) in the coloured micro-structure or the coloured micro-structure complement of the crisp part of 
the VCSP instance. In figures, we will often draw ovals around vertices that are assigned the same colour 
(corresponding to the assignments to the same variable). 

3 VCSPs with crisp binary constraints 

In this section we restrict our attention to binary VCSP instances with crisp binary constraints. There are no 
restrictions on unary constraints; hence both crisp and soft unary constraints are allowed. It follows from a 
recent result of Takhanov [33] that there is a P /NP-hard dichotomy for VCSPs in which all unary constraints 
are allowed and all binary crisp constraints belong to a particular language. It is an open question whether 
a similar dichotomy exists for hybrid classes. We show how tractability results on the maximum weight 
independent set in perfect, fork-free and apple-free graphs can be used to obtain hybrid tractable classes of 
VCSPs. 

Let G be a graph G = (V, E) with weights w : V — > Q+ on the vertices of G. The weight of an 
independent set S in G, denoted w(S), is the sum of weights of the vertices in S: w(S) — Y^veS w ( v )- It i s 
easy to show that given a binary VCSP instance V where only unary constraints can be soft, V can be solved 
by finding a maximum weight independent set in the micro-structure complement of V with weights given 
by w({vi, a)) = Mn — Cj(a), where M is strictly greater than the maximum finite unary cost Ci(a). Indeed, 
independent sets of weight strictly greater than Mn(n — 1) are in one-to-one correspondence with consistent 
assignments to n variables in V (since Vi, Va, < Ci(a) < M implies that the weight of an independent set of 
size n is strictly greater than n(Mn — M) — Mn(n — 1) and the weight of an independent set of size n — 1 is 
at most Mn(n — 1)). 

We now present several important and well-studied classes of graphs which admit a polynomial-time 
algorithm for the maximum weight independent set problem (MWIS). 

Given a graph G, the line graph of G, denote by L(G), is a graph such that each vertex of L(G) represents 
an edge of G, and two vertices of L(G) are adjacent if, and only if, their corresponding edges share a vertex 
in G. Beinike gave a characterisation of line graphs in terms of 9 forbidden induced subgraphs [21] (see 
Figure 1). Since an independent set in the line graph L{G) of a graph G corresponds to a matching of G, 
Edmond's algorithm for the maximum matching problem [22, 23] can be used for MWIS in line graphs. 

A graph is claw-free if it does not contain a claw as an induced subgraph, where a claw is a complete 
bipartite graph with 1 vertex in one group and 3 vertices in the other group (see Figure 2 (b)). Since 
Beineke's characterisation of line graphs in terms of the set of nine forbidden induced subgraphs shown in 
Figure 1 includes a claw (top left graph in Figure 1), it follows that line graphs form a strict subset of 
claw-free graphs. Extending Edmond's algorithm for maximum matchings in graphs [22, 23], Minty designed 
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Figure 1: The nine minimal non-line graphs. 




(a) : P4 (6): claw (c): fork 



Figure 2: A P 4 , a claw and a fork. 



an algorithm for the independent set problem in claw- free graphs [24]. Minty's algorithm was later corrected 
and extended to the maximum weight independent set problem in claw- free graphs [25]. 

A graph is P^-free if it does not contain a P4 as an induced subgraph, where P4 is a chordless path on 4 
vertices (see Figure 2 (a)). MWIS is known to be solvable in polynomial time in P^j-free graphs [26]. 

A graph is fork-free if it docs not contain a fork (also called a chair) as an induced subgraph, where a 
fork is obtained from a claw by a single subdivision of its edges (see Figure 2 (c)). Since P4 and claw are 
subgraphs of fork, it is clear that the class of fork-free graphs properly includes both Pi-free and claw-free 
graphs. 

Lozin and Milanic have recently shown that MWIS is solvable in polynomial time in fork- free graphs [27], 
thus generalising the result of Alekseev for the unweighted case [28]. 

A graph is apple-free if it contains no At, k > 4, as an induced subgraph, where Ah, called an apple, is a 
graph obtained from a chordless cycle Ck of length k > 4 by adding a vertex that has exactly one neighbour 
on the cycle (see Figure 3 for A4,A$ and Aq). The class of apple- free graphs properly includes claw- free 
graphs, and the MWIS problem is solvable in polynomial time [29]. 2 



We now turn our attention to a different well-studied class of graphs. A graph G is perfect if for every 
induced subgraph H of G, the chromatic number (the smallest number of colours needed to colour vertices 
of H such that adjacent vertices are coloured differently) of H is equal to the size of the largest clique in H . 
The Strong Perfect Graph Theorem states that a graph G is perfect if, and only if, G does not contain any 
cycle of odd length Cgfc+i, k > 2, (known as a hole) nor any complement of a cycle of odd length C2fc+i, 
fc > 2, (known as an antihole) as an induced subgraph [ ]. It follows that a graph is perfect if, and only if, 
its complement is perfect. Figure 4 shows couples of forbidden induced subgraphs from the infinite class of 
forbidden induced subgraphs that characterises perfect graphs. It is known that MWIS in perfect graphs is 
solvable in polynomial time [ ]. Moreover, perfect graphs can be recognised in polynomial time [32]. The 
combination of these results gives: 

Theorem 3.1. The class of VCSP instances with crisp binary and arbitrary unary constraints whose micro- 
structure complement is either perfect, fork-free or apple-free is tractable. 

The tractability of VCSPs with perfect micro-structure (complement) and soft unary constraints was also 
independently pointed out by Takhanov [33] and Jebara [34]. 

It is not possible to express all properties of VCSP or CSP instances uniquely in terms of properties of 
the micro-structure, since the micro-structure is a graph which does not contain the important information 
telling us which of its vertices correspond to assignments to the same variables. This information is, however, 
contained in the coloured micro-structure. This is why in the rest of the paper we consider properties of the 
coloured micro-structure in order to define novel tractable hybrid classes. 

2 Note that the class of apple- free graphs is the first class mentioned in this section for which it is not obvious that the 
recognition problem is solvable in polynomial time. However, the polynomial-time algorithm given in [29] is robust in the sense 
that it does not require the input graph G to be apple-free; the algorithm either finds an independent set of maximum weight 
in G, or reports that G is not apple-free. 




Figure 3: Apples. 
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Figure 4: An infinite class of minimal non-perfect graphs. 

4 Polynomially-bounded search 

The tractable classes discussed in Section 3 can be defined by an objective function which is of the form 
Ffin + Fi n f, where Ffi n is a finite- valued function (the sum of unary cost functions) and Fi n f is a {0,oo}- 
valued function (whose micro-structure complement is perfect, fork- free or apple- free). In this section, we 
study other ways of defining tractable hybrid classes of VCSPs with an objective function of the form 
Ffin + Fi n f, but where Ffi n is no longer simply the sum of unary cost functions. 

4.1 Polynomial number of solutions 

Notice that the crisp constraints given by F m / must define a tractable class of CSPs. If, moreover, the 
crisp constraints are so strong that the total number of feasible solutions (i.e. assignments of finite cost) is 
polynomially-bounded and these feasible solutions can be found in polynomial time, then the finite component 
Ffin of the objective function can be arbitrary: an optimal assignment can be found in polynomial time by 
simply exhausting over all feasible solutions. 

Example 4.1. Let V be a binary VCSP instance and let M be the coloured micro-structure of the crisp 
component Fi n f of V . Assuming that M does not contain the pattern from Figure 5 (a) as an induced 
substructure, V has only polynomially many feasible solutions, as any assignment to two variables, say i and 
j, can be extended to at most one assignment to another variable, say k. This can be clearly generalised to 
arbitrary fixed k > 3; the forbidden pattern would consist of a clique of size k — 1 on distinct variables of the 
micro-structure and another 2(fc — 1) edges connecting the vertices of the clique to two different values of the 
fc-the variable. The case k = 4 is depicted in Figure 5 (b): any assignment to three variables has at most one 
assignment to another variable. For a fixed k, this condition is easily recognisable in polynomial time. 

Example 4.2. A binary CSP instance is functional if there exists a variable ordering < such that, for all 
j G {2, . . . , n}, there is some constraint c^- with i < j which is functional from i to j, (i.e., in the notation 
of VCSPs, for each a G Di, there is at most one b G Dj such that Cij(a,b) < oo). In a CSP instance /, a 
root set is a subset Q of the variables such that / becomes functional after instantiation of all variables in 
Q. David [35] showed that it is possible to find a minimum-cardinality root set in polynomial time. Let Gi 
be the directed graph with n vertices and an arc from i to j if / contains a functional constraint from i to j. 
Then the size of the minimum-cardinality root set of I is simply the number of source nodes in the directed 
graph of the strongly connected components of Gj [35] . 

The set of VCSP instances whose crisp component Fi n f of the objective function is a CSP with a root set 
of size bounded by O(logn) represents a tractable hybrid class, independently of the soft constraints Ffi n . 
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Figure 5: Forbidden patterns from Example 4.1. 



4.2 Polynomial number of dead ends 

We say that a set of VCSP instances is conservative if it is closed under arbitrary domain restrictions (i.e. 
the addition of unary crisp constraints) . Another generic tractable case occurs when the CSP represented by 
Fi n f has a polynomial number of dead-ends in a backtracking search tree and the VCSP represented by Ffi n 
is a conservative tractable class. As we will now show, a polynomial number of dead-ends implies that the 
search space can be decomposed into a polynomial number of subspaces. A polynomial number of subspaces 
of solutions can be seen as a strict generalisation of a polynomial number of solutions (since each solution 
can be considered as a trivial subspace), but now we need to be able to minimise the finite component Ffi n 
in polynomial time in each of these subspaces of feasible solutions. 

We introduce some notation. If V is a CSP instance and j < k then V^f. is the instance derived from V 

by 

• keeping only the variables 1, . . . , k, 

• reducing the domains of variables Vj and Vk to {c} and {<£}, respectively, 

• discarding the binary constraints Cik for i = j, . . . , k — 1. 

Definition 4.3. A CSP instance V has the polynomial number of dead-ends property if for all j < k £ 

{1, . . . , n} and for all c £ Dj, d G Dk, Cjk(c, d) = oo implies that the instance Vj£ has a polynomial number 
of solutions which can be found in polynomial time. 

Proposition 4.4. Consider the class of VCSP instances whose objective function is of the form Ffi n +Fi n f, 
where Ffi n is a finite-valued function, Fi n f is a {0, oo} -valued function, the VCSP instance corresponding to 
Ffi n is a conservative tractable class C and Fi n f corresponds to a binary CSP instance with the polynomial 
number of dead-ends property. Then this class is tractable. 

Proof. Let V be a CSP instance satisfying the polynomial number of dead-ends property. Consider the set Sf^ 
of dead-ends in a backtracking search tree which are caused by the fact that the partial solution violates the 
constraint Cjk due to the assignments vj = c and Vk — d. We identify a dead-end at level k of the search tree 
with the corresponding assignment to variables v\ , . . . , Vk- By the polynomial number of dead-ends property, 
it is possible to determine Sj% in polynomial time and, furthermore, S^f is of polynomial size. Let S represent 
the union of all the Sff for all j < k £ {1, . . . , n} and all c £ Dj, d £ Dk- Each assignment (a\, . . . , ak) in S 
can be considered as an interval of non-solutions in the search space ordered by the standard lexicographic 
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ordering (where each domain is ordered according to the order in which the backtracking algorithm exhausts 
over the domain). We can then calculate, in polynomial time, the union Us of these intervals (in the form of 
a set of intervals). The complement of Us (which can be returned as a set of intervals) is the set of solutions 
sol{V) of V. 

To complete the proof, it suffices to show that the finite- valued objective function Ffi n can be minimised in 
polynomial time in each of the polynomial number of intervals in sol{V) where V is the CSP equivalent to Fi n f. 
Since C is a conservative tractable class, we only need to show that a lexicographic interval can be decomposed 
into the union of a polynomial number of sub-intervals each of which is defined by unary crisp constraints. 
Consider the interval / consisting of all assignments between (a±, . . . , a n ) and (61, . . . , b n ) in lexicographic 
order. Let k S {0, . . . , n} be maximal such that Vi £ {1, . . . , fc}, ai = Then / is the set of assignments 
with a prefix of one of the following forms: (1) (aj., . . . , a r , u) with u > a r +i (for r = k + 1, . . . , n — 1), (2) 
(ai, . . . , afe) with afc+i < u < bk+i, (3) . . . , b r , u) with u < 6 r +i (for r = k + 1, . . . , n — 1). Each of these 
sub-intervals can be defined by crisp unary constraints. □ 

Example 4.5. Consider the set of binary VCSP instances whose binary cost functions Cjj are decomposable 
as the sum of a finite- valued cost function and a {0, oo}-valued cost function c{™ + c*™^, where each c(j n is 
submodular and the crisp constraints satisfy the following rule: Vz < max(j, k), Va, b G Di, Vc € Dj, 

W e D k , (a^b)A (<% f (a,c) = c™ f (b,c) = c™ f (a,d) = c™ f (b,d) = 0) => c% f {c,d) = 0. This rule 
is equivalent to forbidding the pattern from Figure 6 as an induced substructure in the coloured micro- 
structure of V, where V is the CSP defined by the crisp constraints c*™^. (Note that the notion of an induced 
substructure requires that there is no edge between (Vj,c) and (vk, d).) This rule implies that in V, whenever 




Figure 6: Forbidden pattern from Example 4.5. 

Cjfc (c, d) — 00, then Vj£ has at most one solution since in each domain Di (i < max(j, k)) there is at most one 
value a which is consistent with the two (variable, value) assignments (vj,c), (vk,d). This clearly implies the 
polynomial number of dead-ends property. Hence this set of VCSP instances is tractable by Proposition 4.4, 
since the class of VCSPs with submodular cost functions is conservative and tractable [14]. 

4.3 Broken-triangle property 

We have seen that forbidding certain patterns in the coloured micro-structure guarantees a polynomial number 
of solutions or dead ends, which in turn allows us to establish the tractability of certain classes of VCSPs. 
The recently discovered broken-triangle property (BTP) [ ], which is also equivalent to forbidding a pattern 
in the coloured micro-structure of a CSP, guarantees that a feasible solution can be found in polynomial time. 
However, the BTP does not guarantee a polynomial number of solutions nor a polynomial number of dead 
ends. Indeed, in this section, we show that the hybrid tractable class of CSPs defined by the broken-triangle 
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Figure 7: Forbidden pattern denning the broken-triangle property. 



property is not extendible to VCSPs with soft unary constraints. A binary CSP instance V satisfies the 
broken-triangle property with respect to the variable ordering < if, and only if, for all triples of variables 
Vi,Vj,Vk such that i < j < k, if Cij(u,v) < oo, Cik{u,a) < oo and Cjk{v,b) < oo, then either Cik{u,b) < oo or 
Cjk{v,a) < oo. (In other words, every "broken" triangle a — u — v — b can be closed.) This is equivalent 
to forbidding the pattern from Figure 7 as an induced substructure in the coloured micro-structure of V . 

Theorem 4.6. Assuming P^NP, the broken-triangle property cannot be extended to a tractable class includ- 
ing soft unary constraints. 

Proof. Let (G, k) be an instance of the decision version of the maximum independent set problem which 
consists in deciding whether there is an independent set of size at least k in graph G. This problem is 
known to be NP-complete [36] . We now transform this instance into a binary VCSP instance with soft unary 
constraints that satisfies the broken-triangle property. 

Every vertex of G is represented by a Boolean variable Vi where Di — {0, 1}. We impose the constraint 
((vi,Vj), {(0, 0), (0, 1), (1, 0)}} if the vertices corresponding to Uj and vj are adjacent in G. Now the assign- 
ments satisfying all constraints are in one-to-one correspondence with independent sets I in G, where vertex 
i 6 / if, and only if, vt = 1. We also impose the soft unary constraints (vi,Ci), where Ci{x) = 1 — x. The 
unary constraints ensure that the goal is to minimise the number of variables assigned value 0, which is the 
same as maximising the number of variables assigned value 1. Therefore, the constructed VCSP instance 
is equivalent to the given maximum independent set problem. It remains to show that the resulting VCSP 
instance satisfies the broken-triangle property with respect to some ordering. In fact, we show that it is 
satisfied with respect to any ordering. Take any three variables Vi,Vj,Vk- If cither of the pairs of variables 
(vi, v^, (vj, Vk) are not constrained, then the broken-triangle property is trivially satisfied. Assume therefore 
that these two constraints are present. The situation is illustrated in Figure 8. It can be easily checked that 
the broken-triangle property is indeed satisfied whether the constraint on («i,Uj) is {(0,0), (0, 1), (1,0)} (as 
shown in Figure 8) or the complete constraint. □ 



5 Joint-winner property 

In this section we define the joint- winner property (see Figure 9), which is the key concept in this paper. 
We present several examples of known tractable problems that are generalised by the joint- winner property. 
We also study basic properties of VCSPs satisfying the joint-winner property as these will be important in 
designing a polynomial-time algorithm in Section 5.3. 
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Figure 8: VCSP encoding maximum independent set. 
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Figure 9: The joint-winner property: Cy(a, b) > min(cjfe(a, c), Cjk(b, c)). 

Definition 5.1 (Joint-winner property). A triple of variables (vi,Vj,Vk) satisfies the joint-winner property 
(JWP) if Cij(a, b) > min(cifc(a, c), Cjk(b, c)) for all domain values a G Di,b S Dj,c <E Dfc. 

j4 binary VCSP instance satisfies the joint-winner property if every triple of distinct variables of the 
instance satisfies the joint-winner property. 

Note that the joint- winner property places no restrictions on the unary constraints Ci and is hence con- 
servative. 

5.1 Examples of the JWP 

Example 5.2. The joint-winner property on a binary CSP instance amounts to forbidding the multiset 
of binary costs {a, oo, oo} (for a < oo) in any triangle formed by three assignments to distinct variables. 
Equivalently (given that the cost a corresponds to allowed assignments and thus non-edges in the micro- 
structure complement), a CSP instance V satisfies the joint winner property if, and only if, the coloured 
micro-structure complement of V forbids the structure in Figure 10 as an induced substructure. Since this 
combination can never occur on triples of variables (vi,Vj,Vk) constrained by the three binary constraints 
v i v j ¥" v k v ii the class of CSPs satisfying the joint-winner property generalises the AllDifferent 
constraint with arbitrary soft unary constraints. This generalisation is equivalent to allowing at most one 
assignment from each of a set of disjoint sets of (variable,value) assignments. 

Example 5.3. Consider the (unweighted) MAX-2SAT problem with no repeated clauses, which is a well- 
known NP-complete problem [36, 37]. An instance (f> of MAX-2SAT, where <fi is a 2-CNF formula, can be seen 
as a Boolean binary {0, l}-valued VCSP instance. The joint- winner property is equivalent to the following 
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Figure 10: The crisp variant of the joint-winner property from Example 5.2. 

condition on cf>: if (I V li) £ <f> and (I V 1%) £ <f>, then (Zi V I2) £ 4>, where I, li, I2 are three literals of distinct 
variables. 

As the next example shows, the well-known hybrid tractable class SoftAllDiff satisfies the JWP, thus 
showing that the JWP defines a hybrid tractable class (the tractability of the JWP being shown later in 
Section 5.3). 

Example 5.4. One of the most commonly used global constraints is the AllDifferent constraint [38]. 
Petit et al. introduced a soft version of the AllDifferent constraint, SoftAllDiff [39]. They proposed 
two types of costs to be minimised: graph- and variable-based costs. The former counts the number of 
equalities, whilst the latter counts the number of variables violating an AllDifferent constraint. The 
algorithms for filtering these constraints, introduced in the same paper, were then improved by van Hoeve 
et al. [40]. 

It is easy to check that the graph-based variant of the SoftAllDiff constraint satisfies the joint-winner 
property. In this case for every i and j, the cost function cy is defined as (a, b) = 1 if a = b, and Cij (a, b) = 
otherwise. Take any three variables Vi,Vj,Vk and a £ Di,b £ Dj,c £ Dk- If cy(a, 6) = Cjk(b,c) — Cik(a,c) 
(which means that that the domain values a, 6, c are all equal or all different), then the joint-winner property 
is satisfied trivially. If only one of of the costs is 1, then the joint- winner property is satisfied as well. Observe 
that due to the transitivity of equality it cannot happen that only one of the costs is 0. 

In order to code the variable-based SoftAllDiff constraint as a binary VCSP V, we can create n 
variables v\ with domains Di x {1,2}. The assignment v[ = (a, 1) means that Vi is the first variable of the 
original CSP to be assigned the value a, whereas v[ = (a, 2) means that Vi is assigned a but it is not the first 
such variable. In V there is a crisp constraint which disallows v[ = v'j = (a, 1) (for any value a £ Di D Dj) 
for each pair of variables i < j together with a soft unary constraint c^(a, k) = k — 1 (for fc = 1,2) for each 
i £ {1, . . . , n}. Hence at most one variable can be the first to be assigned a, and each assignment of the value 
a to a variable (apart from the first) incurs a cost of 1. Again due to the transitivity of equality, it cannot 
happen that only one of the binary costs shown in the triangle of Figure 9 is zero, from which it follows 
immediately that the joint- winner property is satisfied in V . 

We remark that the class defined by the JWP is strictly bigger than SoftAllDiff, and hence our generic 
algorithm is not as efficient as tailor-made algorithms for SoftAllDiff. 

Example 5.5. Suppose that n jobs must be assigned to d machines. Let U{m) be the length of time required 
for machine m to complete job i. If machine m cannot perform job i, then li(m) = 00. We use variable to 
represent the machine to which job i is assigned. The set of jobs (which we denote by S m ) assigned to the 
same machine m are performed in series in increasing order of their length Z,(m). The aim is to minimise T 
the sum, over all jobs, of their time until completion. If jobs i and j are assigned to the same machine, and 
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li(m) < lj(m), then job j will have to wait during the execution of job i, contributing a time of li{m) to the 
sum T. This means that 
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In other words, optimal assignments of jobs to machines are given by solutions to the binary VCSP with 
unary constraints Ci(m) — li(m) (representing the execution times of jobs) and binary constraints 



(representing the waiting times of jobs). 

The joint-winner property Cij(a,b) > min(c,fc(a, c), Cyfe(i>, c)) is trivially satisfied in this VCSP instance if 
a, b, c are not all equal, since in this case one of Cik{a, c), Cjk(b, c) is zero. It is also satisfied when a = b = c = m 
since mm(li(m),lj(rn)) > min(min(Zi(m), /^(m)), min(Zj -(m), Zfc(m))). 

This problem has been shown solvable in polynomial time in [41, 42]. 

5.2 Structure of problems satisfying the JWP 

The next lemma explains the reason for the name of the joint-winner property: in every triangle there is no 
unique smallest cost. 

Lemma 5.6. A VCSP instance satisfies the joint-winner property if, and only if, for all triples of distinct 
variables {vi,Vj,Vk) and for all a £ -Dj, b £ Dj, c £ D^, two of the costs Cij(a,b),Cik{a,c),Cjk{b,c) are equal 
and less than or equal to the third. 

Proof. Assume that the joint- winner property is satisfied on the triples of variables (vi,Vj,Vk), (vj,Vk,Vi) 
and (vk,Vi,Vj), and write a — Cij(a,b), /3 = Cik(a,c) and 7 = Cjk(b,c). Without loss of generality, let 
a = min(o!, j3, 7). From a > min(/3, 7), we can deduce that a = min(/3, 7) and hence that two of a, j3, 7 are 
equal and less than or equal to the third. 

On the other hand, if two of a, /3, 7 are equal and less than or equal to the third, then min(/3, 7) = 
min(a, /?, 7) < a and the JWP is satisfied. □ 

Remark 5.7. The joint-winner property is somewhat similar to the ultra-metric inequality. In this remark 
we will clarify the relationship. 

An ultra-metric space is a set of points M with an associated distance function (also called a metric) 
d:MxM-tl, where K is the set of real numbers, such that for x,y,z£M the following axioms hold: 

1. d(x,y) >0 

2. d(x, y) = if, and only if, x = y 

3. d(x, y) = d(y, x) (symmetry) 

4. d{x,z) > mm(d(x, y), d(y, z)) (ultra- metric inequality) . 

It is well known that in an ultra-metric space, every triangle is isosceles (cf. Lemma 5.6). 

Let V be a binary VCSP instance. Let M = {(vi,a)\a £ Di} be the set of vertices of the micro-structure 
of V . Let d((vi,a), (vj,b)) — Cij(a,b) when i j, and let d((vi,a),(vi,b)) = 00 when a ^ b. Now if V 
satisfies the joint-winner property, then the ultra-metric inequality is satisfied by any three x,y,z £ M if 
x, y, z correspond to assignments to three different variables of V . However, the JWP does not require, 
for instance, that d({vi,a), (vj,b)) > min(d({vi, a), {Vj, c)), d({vj, 6), (vj, c))). Hence d does not satisfy the 
ultra-metric inequality on M. 




13 



We say that the binary constraint on variables Vi,Vj has a Z- configuration on sub-domains {a, b} C Di, 
{c, d} C Dj if Cij(a,c),Cij(b,c),Cij(b,d) > Cij(a,d). Since the JWP imposes a condition on exactly three 
variables, it imposes no condition on individual binary constraints. In particular, Z-configurations may 
occur. However, we will show that all Z-configurations can be eliminated by a simple pre-processing step. 
This will greatly simplify the structure of the instance allowing us to apply a min-cost max-flow algorithm 
to solve JWP instances. 

We say that the pair of sub-domains (Si,Sj) (where Si C Di, Sj C Dj) is independent of the other 
variables if Va, b G Si, Vc, d G 6y, Vfc $ {«, j}, Ve £ £>/., Cj&(a, e) = Cjfe(6, e) = Cjk(c, e) = Cjk{d, e). 

Lemma 5.8. If a binary VCSP satisfying the JWP has a Z- configuration on sub-domains {a, b} C Di, 
{c,d} C D J; i/ien ({a, &}, {c, d}) is independent of the other variables. 

Proof. Without loss of generality, the presence of a Z-configuration means that cy(a, c), Cjj(6, c), cy (6, d) > /3 
where Cy(a, d) = /3. Consider some fe g 1 and some e G By the JWP on the triple of assignments 

{(vi,a), (vj,d), (vk,e)}, we have either (1) Cjfe(a, e) < f3 or (2) Cjk(d,e) < f3. In case (1), by repeated 
application of the JWP on the triples of assignments {(vi,a), {Vj,c), (v k ,e)}, {(vi,b), (vj,c), (vk,e)}, and 
{(vi,b), (Vj,d), (v k ,e)}, we can deduce that c lk (a,e) = c jk (c,e) = c ik (b,e) = c ^ k (d,e). In case (2), applying 
the JWP on the same triples, but in the reverse order, again allows us to deduce that Ci k (a,e) = Cj k (c,e) — 
c ik (b, e) = Cj k (d, e). □ 

Lemma 5.9. In a VCSP instance satisfying the JWP, if (Si, Sj) (where Si C Di, Sj C Dj) is independent of 
the other variables, and f G Di — Si is such that 3c, d G Sj such that Cj,-(/, c) ^ Cij(f,d), then (Si U {f},Cj) 
is independent of the other variables. 

Proof. Consider any variable k g" {i, j} and any e G D k . Since (Si, Sj) is independent of the other variables, 
Cj k (c, e) = Cj k (d,e). By applying the JWP on the two triples of assignments {(i>j,/), (vj,c), (v k ,e)} and 
{( v ii f)i (Vj, d), (v k , e}}, we can deduce that either Ci k (f, e) is equal to Cj k (c, e) = Cj k (d, e) or Ci k (f, e) is equal 
to both of Cij (/, c) and Cij(f, d) (which is impossible since Cy-(/, c) ^ (/, d)). This shows that (Si U{/}, Cf) 
is independent of the other variables. □ 

We say that (Si, Sj) is independent of other domain-values if Vc, d G Sj, V/ G Di — Si, Ctj(f, c) = Cij(f, d) 
and Va, b G Si, \/g G Dj — Sj, Cij(a,g) = Cij(b,dg). 

Given a Z-configuration on {a, 6} C Dj, {c, d} C D^, we can use a simple algorithm to build a maximal pair 
of sub-domains (Si, Sj) which is independent of the other variables (and such that {a, 6} C Si, {c, d} C Sj). 
From Lemma 5.8, we can initialize (Si,Sj) to ({a, b}, {c, d}). Then, by Lemma 5.9 we can simply keep 
adding / G Di — Si to Si if 3c', d! G Sj such that Cij(f, c') ^ %(/, d'), and, by symmetry, we can keep adding 
,g G Dj — Sj to Sj if 3a', 6' G Sj such that Cij(a',g) ^ Cij(b',g). When this process converges, (Si,Sj) is not 
only independent of the other variables but also independent of other domain- values. 

Now let po G Si minimise Ci(a), where a G Si. Similarly, let go G Sj minimise Cj(a), where a G Sj. 
Furthermore, let p\ G Si and gi G Sj be the pair that minimises Ci(a) +Cj(b) + cy(a, b) for a G Sj and 6 G Sj. 
We replace the sub-domains Si,Sj by the single domain values p, q where Ci(p) = Ci(po), Cj(q) = Cj(qo), and 
Cij(p,q) = c i j(p 1 ,qi) + (c i (pi)-c i (po)) + (cj(qi)-Cj(q )) so that Ci(p) + c i:j (p,q) + Cj(q) = c ij (p 1 ,q 1 ) + c l (p 1 ) + 
Cj(qx). For all / G A - Sj, we set c tj (f,q) = Cij(f,q ) and for all g e Dj - Sj, we set c i2 (p,g) = Cij(p ,g). 
Also Vfc g Vu G Dfc, c ik (p,u) = c ik (p ,u) = c ik (pi,u) and c ]k (q,u) = c jk (q ,u) = c 3k (q 1 ,u). The pair 

of domain values p, q simulate either po or go if only one of the values p, q is used but simulates p\ , gi if both 
values are used. We observe that this substitution preserves the JWP property. This is trivially true in all 
triangles involving only one of the assignments p, q, since the binary costs are identical to those for po,qo- 
Since Si, Sj are independent of the other variables, any triangle of costs involving both assignments p\, q\ is 
isosceles. In particular, for any u G D k , where k ^ i and k ^ j, Ci k (p\,u) = Cj k (q\,u) = a and Cij(p%, q%) > a. 
Since c ik (p,u) = c ik (pi,u) = c jk (qi,u) = c jk (q,u) and c i3 (p,q) > c tJ (pi,qi), the JWP property is preserved. 

This substitution operation is guaranteed to preserve at least one optimal solution. This is because, by 
our choice of Po,qo,Pi,Qi, (1) in any assignment x (to all n variables) in which Xi G Si, Xj g" Sj, replacing 
%i by po (or by p which is equivalent) cannot increase its cost, (2) in any assignment x in which Xi ^ Si, 
Xj G Sj, replacing Xj by go (or by g) cannot increase its cost, and (3) in any assignment x in which Xi £ Si, 
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xj G Sj , simultaneously replacing a;, by pi and Xj by qi (or replacing a;, by p and Xj by g) cannot increase 
its cost. 

We say that a VCSP instance satisfying the JWP is Z-free it contains no Z-configurations. We know that 
a VCSP satisfying the JWP can be made Z-free by applying the above pre-processing step to eliminate all 
Z-configurations. This pre-processing is clearly polynomial-time. A naive algorithm requires 0(n 2 d 4 ) time to 
detect all Z-configurations. For a given pair (<§,-, Sj), when a new domain value g is added to Sj we have to 
test for all / G D^ — Si whether 3c G Sj such that Cy •(/, c) ^ <kj(f: g)- This is an O(cP) operation. By a simple 
counting argument, we can see that the total number of times some domain value is added to some set Si is 
less than the total number of (variable,value) assignments which are eliminated by the substitution operation 
described above, which, in turn, is bounded above by nd. Thus the total complexity of the pre-processing 
operation is 0(n 2 d 4 + nd 3 ) and hence 0(n 2 d A ). 

Definition 5.10. LetV be a binary VCSP instance. A subgraph C — (Vc,Ec) of the micro-structure ofV is 
an assignment-clique if C forms a clique in the micro- structure ofV when all edges between assignments to the 
same variable are added to Ec, i.e. (Vc,Ec U Sc) is a clique, where Sc = {{(vi, a), (Uj, b)} : (uj, a), (wj, b) G 
Vc and a b}. 

Lemma 5.11. LetV be a Z-free binary VCSP instance satisfying the JWP. Then, for a fixed a, the edges of 
the micro- structure of V corresponding to binary costs of at least a, together with the corresponding vertices, 
form non-intersecting assignment- cliques. 

Proof. Since V is Z-free, within a single binary constraint any connected set of edges of the micro-structure 
of V corresponding to binary costs of at least a form a clique. For a contradiction let us assume that the 
edges of the micro-structure of V corresponding to binary costs of at least a do not form non-intersecting 
assignment-cliques. Hence there are three vertices (vi, a), {vj, b), (vk,c) (where k are distinct) of the 
micro-structure such that Cij(a,b) > a, Cjfc(a, c) > a, and Cjk(b,c) < a. But this is in contradiction with 
Lemma 5.6. □ 

In the rest of the paper, when we refer to an assignment-clique C a of edges in the micro-structure 
corresponding to binary costs of at least a, we implicitly assume that C a is maximal. 

Lemma 5.12. Let V be a Z-free binary VCSP instance satisfying the JWP. Let C a be an assignment-clique 
in the micro- structure of V corresponding to binary costs of at least a, and Cp an assignment- clique in 
the micro- structure of V corresponding to binary costs of at least j3. If C a intersects Cp and a < f3, then 

Proof. Suppose that C a and Cp intersect and a < f3. If a = j3, the claim is satisfied trivially by Lemma 5.11, 
so we can suppose that a < /?. For a contradiction, assume that C a 2 C/3- By our assumptions, 3(vi,a) € 
C a n C/3 and 3(vj, b) G Cp \C a . Since Cp is an assignment-clique, we must have Cij(a, b) > /3 > a. Thus, by 
Lemma 5.11, the edge {(Vj, b), a)} is part of an assignment-clique C' a of edges of cost at least a (but not 
C a since (vj,b) $ C a ). But then C a and C' a intersect at (vi,a) which contradicts Lemma 5.11. □ 

5.3 Algorithm 

In this section we present a polynomial-time algorithm for solving Z-free binary VCSPs satisfying the joint- 
winner property. The algorithm is an extension of a reduction to the standard max-flow/min-cut problem 
that has been used for flow-based soft global constraints [43, 40, 44]. 

First we review some basics on flows in graphs (see [45] for more details). Let G = (V,A) be a directed 
graph with vertex set V and arc set A. To each arc a G A we assign a demand/capacity function [d(a),c(a)] 
and a weight function w(a). Let s, t G V. A function / : A — > Q is called an s — t flow (or a flow) if 

• f(a) > for all a G A; 

• for all v G V\ {s,t}, E a =(«,-u)e^ /( a ) = T, a =(v,u)eA f( a ) ( flow conservation). 
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We say that a flow is feasible if d(a) < f(a) < c(a) for each a G A. We define the value of flow / as 
val(f) = J2a=( s ,v)eAf( a ) ~ J2a=(v,s)eAf( a )- We define the cost of flow / as ^2 aeA w(a)f(a). A minimum- 
cost flow is a feasible flow with minimum cost. 

Algorithms for finding the minimum-cost flow of a given value are described in [46, Chapter 12] and [45]. 
Given a network G with integer demand and capacity functions, the successive shortest path algorithm [46], 
can be used to find a feasible s — t flow with value a and minimum cost in time 0(a ■ SP), where SP is the 
time to compute a shortest directed path in G. 

Given a Z-free binary VCSP V satisfying the JWP, we construct a directed graph G-p whose minimum- 
cost integral flows of value n are in one-to-one correspondence with the solutions to V. Apart from the source 
node s, G-p has three types of node: 

1. a variable node Vi (i = 1, . . . , n) for each variable of V; 

2. an assignment node (vi, a) (a G Di, i = 1, . . . ,n) for each possible variable- value assignment in V; 

3. an assignment-clique node C a for each maximal assignment-clique of edges in the micro-structure of V 
corresponding to binary costs of at least a. (The subscript a is equal to the minimum cost of edges in 
the assignment-clique and, where necessary, we use C a , C' a , . . . to denote the distinct non- intersecting 
assignment-cliques corresponding to the same value of a.) 

In G-p there is an arc (s, Vi) for each variable Vi of V . For all variables Vi and for each a £ Di, there is an arc 
(t>i, (vi, a}) and also an arc from (vi, a) to the assignment-clique C a containing (uj, a) such that a is maximal 
(d is unique by Lemma 5.12). 

We say that assignment-clique Cp is the father of assignment-clique C a if it is the minimal assignment- 
clique which properly contains C a , i.e. C a C Cp (and hence a > (3) and $C 7 such that C a C C 7 C Cp (Cp is 
unique by Lemma 5.12). In Cp, for each assignment-clique C a with father Cp, there is a bundle of arcs from 
C a to Cp consisting of r arcs ei (i = 1, . . . , r), where r is the number of vertices in the assignment-clique C a . 
The weight of arc from C a to C^ is tu(ej) = (i — l)(a — /3). (If a = oo then there is a single arc of weight 
0; the arcs of weight oo can simply be omitted.) We identify the sink node t with the assignment-clique Co 
consisting of all edges in the micro-structure (since all binary costs are at least 0). 

Each arc has demand and capacity 1 except for arcs (s,Vi) which have both demand 1 and capacity 1 
(this forces a flow of exactly 1 through each variable node Vi). Weights of all arcs are except for arcs going 
from an assignment-clique node to its father assignment-clique node, as described above, and arcs from a 
variable node Vi to an assignment node (vt,a) which have a weight of Ci(a). 

We show below that integral flows in the constructed network are in one-to-one correspondence with 
assignments in V , but first we give an example. 

Example 5.13. We show the general construction on a simple example. Let V be a VCSP instance with 
variables v\,vi,v^ and D\ = D 2 = {a,b}, D3 — {a}. The coloured micro-structure of V is shown in 
Figure 11. Missing edges have cost 0. There are two assignment-cliques corresponding to cost at least 
1: C\ = {(vi, a), (1)2, a), (1)3, a)} (in solid red in Figure 11) and C[ — {(v\, b), (v2, b)} (in dotted blue in 
Figure 11); and one assignment-clique corresponding to cost at least 2: Co = {(i>i, a), {v 2 , a)} (in dashed 
green in Figure 11). The network corresponding to instance V is shown in Figure 12: demands and capacities 
are in square brackets, and weights of arcs without numbers are 0. The bold red edges represent flow / 
corresponding to the assignment v± — vi = V3 = a with total cost 4, which is the same as the cost of /. 

We now prove that integral flows / in G-p are in one-to-one correspondence with assignments in the VCSP 
V and, furthermore, that the cost of / is equal to the cost in V of the corresponding assignment. 

All feasible flows have value n since all n arcs (s, Uj) leaving the source have both demand and capacity 
equal to 1. Integral flows in G-p necessarily correspond to the assignment of a unique value ai to each variable 
Vi since the flow of 1 through node Vi must traverse a node (i^a,) for some unique a; € It remains to 
show that for every assignment (ai, . . . ,a n ) to (vi,... ,v n ) which is feasible (i.e. whose cost in V is finite), 
there is a corresponding minimum-cost integral feasible flow / in Cp of cost Ciifli) + Sj<j c ij{ a ii a j)- 

For each arc a which is incoming to or outgoing from (vi, u) in Cp, let /(a) = 1 if it = <Zj and otherwise. 
We denote the number of assignments (u,,aj) in assignment-clique C Q by N(C a ) = \{{vi,a,i) G C a : 1 < i < 
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n} | . By construction, each assignment-clique node C a in G-p only has outgoing arcs to its father assignment- 
clique. For the outgoing arc a of weight i from C a to its father assignment-clique, let f(a) = 1 if N(C a ) > i 
and otherwise. This simply means that the outgoing arcs (each of capacity 1) from C a are used in increasing 
order of their weight, one per assignment (uj,aj) £ C a . This is clearly a minimum-cost flow corresponding 
to the assignment (a\, . . . , a n ). 

Let cf(C a ) denote the cost (3 of the father assignment-clique Cp of C a . The cost of flow / is given by 
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This corresponds precisely to the cost of the assignment (oi, . . . ,a n ) in V, since in an assignment-clique C a 
with father assignment-clique Cp, each of the (N(C a ) — l)N(C a )/2 binary constraints contributes a cost of 
a — (3 over and above the cost of j3 for each of the edges in Cp. 

For the rest of this section, let d = maxi<K„ \Di\ be the size of the largest domain. Given a VCSP 
instance satisfying the joint-winner property, there are clearly at most \Di\ x \Dj \ different costs in the cost 
function Cy . Hence in total there are at most 0(n 2 d 2 ) different maximal assignment-cliques C a . We now 
improve this upper bound to 0(nd). 

Lemma 5.14. A Z-free binary VCSP instance V satisfying the joint-winner property has at most 2nd — 1 
different maximal assignment- cliques C a . 

Proof. Consider binary VCSP instances V satisfying the joint-winner property and whose micro-structure 
has N = nd vertices. Let An be the maximum number of assignment-cliques C a in such instances V . We 
prove by induction that A^ < 2N — 1. Clearly, A\ = 1. Consider a micro-structure of size N. Consider any 
assignment-clique C a of V which does not include all (variable, value) assignments of V but which is maximal 
in the sense that there is no other such assignment-clique Cp D C a . Let r = \C a \. By Lemma 5.12 and 
by maximality of C a , no other assignment-clique Cp can intersect both C a and its complement except an 
assignment-clique containing all the vertices of the micro-structure of V. Hence we can partition the micro- 
structure of V (creating two VCSPs with micro-structures of size r and N — r) and obtain the following 
recurrence: An < 1 + A r + Ajy- r . From the inductive hypothesis, A r < 2r — 1 and A^-r < 2{N — r) — 1. 
Since 1 + 2r - 1 + 2(N - r) - 1 = 2N - 1, it follows that A N < 2N - 1. □ 

We show that instances satisfying the joint-winner property can be recognised and solved in cubic time. 

Theorem 5.15. VCSPs satisfying the joint-winner property are solvable in polynomial time. 

Proof. From Definition 5.1, recognition can be achieved in 0(n 3 d 3 ) time. We have seen that a VCSP satisfying 
the JWP can be made Z-free in 0(n 2 d 4 ) time. 

To solve a Z-free VCSP satisfying the JWP, we create a vertex for each of the assignment-cliques corre- 
sponding to binary costs of at least a. By Lemma 5.14, there are at most 0(nd) different assignment-cliques. 
So our network has 0(nd + nd + n + 2) = 0(nd) vertices. The network can be built in 0(n 3 d 3 ) time by 
0(n<i)-times invoking depth-first search on the micro-structure of the instance, which is of size 0(n 2 d 2 ). 

The result follows from the fact that a polynomial-time algorithm exists for determining a minimum-cost 
maximum flow in a network. In particular, using the successive shortest path algorithm, the running time is 
0(n ■ SP), where SP is the time to compute a shortest directed path in the network [46, 45]. Using Fibonacci 
heaps, this is 0(n(n 2 d 2 + nd\og(nd))) = 0(n 3 d 2 ). Hence, the complexity to solve a Z-free JWP instance is 
0{n 3 d 3 ). The total complexity, including pre-processing is thus 0{n 2 d 3 {n + d)). □ 
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5.4 Maximality 



Tractable classes defined by structural or language restrictions are often shown to be maximal. That is, any 
extension of the class is NP-hard. We consider that a hybrid tractable class defined by a set of possible 
combinations of costs within a subproblem is maximal if extending it to include any other single combination 
of costs renders the problem NP-hard. In particular, since JWP is defined on 3- variable subproblems, we call 
an instance 3-maximal if extending it to include any other single combination of costs on 3 variables renders 
the problem NP-hard. In this section we show that the joint-winner property defines a 3-maximal tractable 
class. 

We first consider the special case in which all costs belong to {a, (3} (for some fixed distinct costs a < (3). 
In this case, the joint-winner property defines a maximal tractable class, except for the case when the domain 
size is 2 and all costs belong to {a, oo}, where a < oo. This latter case is just the well-known tractable class 
of Boolean binary CSPs [47]. 

Theorem 5.16. If all costs belong to {a, (3} (for some fixed distinct costs a < j3), then the joint-winner 
property defines a maximal tractable class provided d > 2 or (d > 2) A (J3 < oo), where d is the maximum 
domain size. 

Proof. To prove maximality we have to show the NP-hardness of the set of instances defined by the fact 
that in each triangle the triple of costs either satisfies the joint-winner property or is just one other fixed 
combination. Since all costs belong to {a,/3} where a < (3, from Definition 5.1, the only situation forbidden 
by the JWP is that there are 3 variables Vi,Vj,Vk and domain values a G Di,b G Dj,c G Dk such that 
Cij(a,b) — a and Cik(a,c) — Cjk{b,c) — (3. Hence extending the JWP means allowing all combinations of 
costs from {a, f3} in all triangles. 

If /3 = oo, allowing all combinations of costs means that our instance allows all binary relations (corre- 
sponding to the set of finite-cost tuples) and hence we can encode any binary CSP. This is NP-complete if 
d > 2 [37]. 

If (3 < oo, allowing all combinations of costs in {a, {3} is equivalent to the set of instances of MAX-CSP 
in which no two constraints can have the same scope. The NP-hardness of this latter problem for d > 2 
follows from the following reduction from MAX-CSP, which is a well-known NP-complete problem [36, 37]. 
A polynomial-time reduction of an instance I of MAX-CSP into an equivalent instance I' in which no 
two constraints have the same scope can be achieved by replacing each variable in I by M variables v\ 
(j = 1, . . . , M) in I' constrained by a clique of equality constraints, where M is greater than the total number 
of constraints in /. In the optimal solution to I', variables v\ (j = 1, . . . , M) are necessarily assigned the 
same value (otherwise a cost of at least M would be incurred) . □ 

We now prove our main theorem concerning 3-maximality of the joint-winner property. 

Theorem 5.17. The joint-winner property defines a 3-maximal tractable class for any domain size d > 2. 

Proof. Let a < f3 < 7 be any combination of costs which does not satisfy the JWP. To prove 3-maximality 
we have to show the NP-hardness of the set of instances defined by the fact that in each triangle the triple 
of costs either satisfies the joint-winner property or is {ct,/3, 7}. We firstly consider the case 7 < 00. 

It is well known that MAX-CSP is NP-hard [37]. Firstly, we show that binary MAX-CSP (coded as a 
binary VCSP with {0, l}-valued cost functions) is NP-hard even on bipartite graphs. This follows from the 
fact that we can easily convert any instance of binary MAX-CSP into an instance of binary MAX-CSP on a 
bipartite graph, as follows. For each cy(a, b) = 1, introduce an extra Boolean variable Wij a b, and replace the 
cost of 1 for (a, b) in c,j by costs of 1 for (xi, Wij a b) = (a, 0) and (wij a b, Xj) = (1> b) (all other costs being 0). 
In the resulting problem there is an obvious partition: (the original Xi variables, the new Wij a b variables). 

Since < a < (3 < 00, any {0, l}-valued VCSP instance is equivalent to the {a, [3} -valued instance 
obtained by applying the following operation to all cost functions: multiply by j3 — a and add a. Now, given 
any instance of binary MAX-CSP on a bipartite graph (in the form of a {a, /3}-valued binary VCSP), we 
can add a constant cost function (c^ {x, y) = 7 for all x, y) between any pair of variables within the same 
part without changing the problem. This just adds a constant cost to all solutions. In the resulting VCSP, 
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all triangles of costs are {7,7,7}, {a, 07}, {/?, /? 7} or {a, 0, 7}. Thus they either satisfy the JWP or are 
{a, /3, 7}. This polynomial reduction from binary MAX-CSP on bipartite graphs demonstrates NP-hardness 
in the case a < (3 < 00. 

We now consider the case a < (3 < 7 = 00. We demonstrate the NP-hardness of the set of VCSP 
instances such that in each triangle the triple of costs either satisfies the JWP or is {a, (3, 00}. A VCSP 
remains invariant under addition of a constant finite cost and under scaling by a non-zero finite constant 
factor. Thus, for a < (3 < 00, a VCSP such that in each triangle the triple of costs either satisfies the JWP 
or is {a, (3, 00} is equivalent to a VCSP such that in each triangle the triple of costs either satisfies the JWP 
or is {0,l,oo}. We demonstrate NP-hardness of such VCSPs by the following polynomial-time reduction 
from MAX-2SAT. Let I be an instance of MAX-2SAT with variables (i — 1, . . . , n) and let mi be the 
number of clauses in which variable Vi occurs. We construct a VCSP instance V containing rrii copies v\ 
(j = 0, . . . , rtii — 1) of each variable v\. For each i = 1, . . . , n, the m, variables vf (J = 0, . . . , mi — 1) are 
joined together by a cycle of {0, oo}-valued crisp constraints coding the inequalities v\ < vf +1 (where the 
addition in the superscript is modulo mi). Since these crisp constraints form a cycle, they are equivalent to 

= ... = v™*~ . It is easy to verify that this cycle of crisp constraints satisfies the JWP since no triangle 
of binary costs contains two infinite costs. 

The 2SAT clauses of I are replaced by corresponding {0,1 {-valued constraints in V such that the jth 
occurrence of vi in I is replaced by vf in P. By this construction, every triangle of variables in V involves at 
most one {0, l}-valued constraint corresponding to a clause of /. It follows that the triple of costs {0, 1, 1} 
does not occur in any triangle in V . Since infinite cost can only occur in the non-intersecting cycles of crisp 
constraints, the triples of costs {0,oo,oo} and {1, 00,0c} also do not occur in any triangle in V. Thus, in 
each triangle in V the triple of costs either satisfies the JWP or is {0, 1, 00}. Since V is equivalent to /, and 
the reduction is clearly polynomial, this completes the proof of NP-hardness. 

It remains to consider the case a < j3 = 7 = 00. Analogously to the case a < (3 < j — 00, it suffices to 
give a polynomial-time reduction from MAX-2SAT to the set of VCSP instances such that the costs in each 
triangle either satisfy the JWP or are {0, 00, 00}. Let / be an instance of MAX-2SAT. We now build a VCSP 
instance V from / by adding two new variables Xy, y^- for each clause l\ V I2 of I (where Zi , Z2 are literals). 
The clause l\ V I2 of I is replaced in V by a {0, l}-valued constraint on variables Xij, yij encoding the clause 
-<Xij V -ij/jj together with two crisp (i.e. {0, oo}-valued constraints) encoding the clauses l\ V x^ and j/y V ?2- 
It is easy to verify that V is equivalent to / and that the costs in each triangle in V either satisfy the JWP 
or are {0, 00, 00}. This polynomial reduction from MAX-2SAT completes the proof of NP-hardness for the 
final case a < f3 = 7 = 00. □ 

5.5 Non-overlapping convexity property 

Having studied in detail the joint-winner property on triangles of binary costs, a natural question is whether 
it can be generalised to more than three variables. By analysing our algorithm for Z-free binary VCSPs 
satisfying the joint- winner property (Section 5.3), we can extend the class of problems solvable in polynomial 
time using the same approach. This generalisation is no longer restricted to binary VCSPs. In a VCSP 
with constraints of arbitrary arity, the objective function to be minimised is the sum of cost functions 
whose arguments are subsets of arbitrary size of the variables v±, . . . ,v n . For notational convenience, in this 
section we interpret a solution x (i.e. an assignment to the variables Vi,...,v n ) as the set of (variable, value) 
assignments {(«i, Xi) : i = 1, . . . , n}. 

For the following definition, we require the notion of a non-decreasing derivative of a discrete function. 
The derivative of the function / : {0, . . . , s} — > Q + is non- decreasing if /(to + 2) — /(m + 1) > f(m+ 1) — f(m) 
for all to € {0, . . . , s — 2} (where subtraction is extended to Q + by defining 00 — a = 00 for all a £ Q+)- 
Two set S, T are said to be non-overlapping if they are either disjoint or one is a subset of the other (i.e. 
SnT = 0, S C T or T C S). 

Definition 5.18. Let V be a VCSP instance. Let Ci,...,C r be sets of (variable, value) assignments of V 
such that for all Ci and Cj are non-overlapping. Instance V satisfies the non-overlapping convexity 
property if the objective function of V can be written as fi(N(x,Ci)) + ... + f r (N(x,C r )) such that each 
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fi : {0, . . . , Si} Q + (i = 1, . . . , r) is a non-negative non- decreasing function with non- decreasing derivative, 
where N(x,Ci) = \xf\Ci\ is the number of (variable, value) assignments in the solution x which lie in Ci and 
Si is the number of distinct variables occurring in the set of (variable, value) assignments Ci. 

Observe that this definition allows any unary valued constraints, since for each (variable,value) assignment 
(vj,a) we can add the singleton Ci — {(vj,a)} which is necessarily either disjoint or a subset of any other 
set Ck (and furthermore the corresponding function fi : {0, 1} — > Q> + is necessarily a non-negative function 
with a trivially non-decreasing derivative). 

Remark 5.19. To express a binary Z-free VCSP satisfying the JWP in the more general form given in 
Definition 5.18, we add a set of (variable,value) assignments Ci corresponding to each assignment-clique C a 
in the micro-structure, with fi(m) — (™)(a — 0) for m > 0, where Cp is the father assignment-clique of C a . 
It is easy to check that fi is non-negative, non-decreasing and has a non-decreasing derivative. 

Theorem 5.20. Any VCSP instance V satisfying the non-overlapping convex property can be solved in 
polynomial time. 

Proof. We can consider each set of (variable,value) assignments Ci as an assignment-clique: since Ci is a 
subset of the vertices of the micro-structure of V, we just need to add all edges between those vertices 
(vj,a),(vk,b) of Ci representing assignments to distinct variables (J ^ k). 

We build the same network as described in Section 5.3, but have to adjust the weights on edges between 
the assignment-cliques Ci. Recall that Sj represents the number of distinct variables in Ci. Without loss of 
generality, we can assume that /»(0) = 0. (If this is not the case, we can replace fi by // where fl(m) — 
fi(m) — fi(0) to produce an equivalent problem with //(0) = and in which f[ is non- negative, non- 
decreasing and with a non-decreasing derivative.) Let Aj(m) = fi(m) — fi(m — 1) for m = 1, . . . , Sj. Since 
the fi (1 < i < r) are non-decreasing functions with a non-decreasing derivative, A, is non-negative and 
non-decreasing. In the network, there are s, arcs e\ (k = 1, . . . , Sj) from Ci to its (unique) father assignment- 
clique. The weight (cost) of arc e\ is A,-(fc). 

Similarly to the construction in Section 5.3, arcs of weight oo can be omitted. The same argument 
and calculation as in Section 5.3 proves that the algorithm is correct. In particular, we need to show that 
given any feasible assignment x (that is, of finite cost) to a binary VCSP instance V that satisfies the non- 
overlapping convex property, there is a corresponding minimum-cost integral feasible flow / in G-p of cost 
fi(N(x,Ci)) + . . . + f r (N(x,C r )). The same construction of / as in Section 5.3 gives us a flow / of the 
following cost: 

N(C t ) 

E E a -h = 

i rn — 1 



X; [mi) + (/i(2) -/*(!)) + ... 

i 

+ (f i (N(C i )-l)-fi(N(C i )-2)) 
+ (fi(N(Ci)) - fi(N(Ci) - 1))] 

E fi( N ( c i))- 



which corresponds precisely to the cost fi(N(x, C\)) + . . . + f r (N(x, C r )) of the assignment x. To see that 
this flow is a of minimum cost, among flows corresponding to the assignment x, observe that the only choices 
to be made concern the arcs e\. Since the weights A^(fc) of these arcs are non-decreasing, a flow of value v 
which takes the first v arcs e\ (k = 1, . . . , v) is necessarily of minimum cost. □ 

Example 5.21. An example of the non-overlapping convex property is the set of non-binary (i.e. arbitrary 
but fixed maximum arity) CSP (or MAX-CSP) instances with no overlapping nogoods, which we will now 
describe. A CSP is traditionally defined by a set of constraints each of which is given in the form of a scope 
and a relation containing the set of possible assignments to the variables in the scope of the constraint. 
Another way of specifying a CSP instance is by listing its nogoods, where a nogood is a set of (variable, value) 
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assignments which cannot simultaneously be made. The nogoods are easily obtained from the complement 
of each constraint relation. A CSP instance with no overlapping nogoods is such that for all nogoods N, Nj, 
either N n Nj = 0, N C Nj or Nj C N. 

To see that any CSP (or MAX-CSP) instance / with non-overlapping nogoods N\,...,N r satisfies the 
non-overlapping convex property, for i = l,...,r, define by /j(|iV»|) = oo (or /i(|iVj|) = 1 in the case of 
MAX-CSP) and fi(m) — for m < \N\. Clearly each /j is a non- negative (non-decreasing) function with a 
non-decreasing derivative and the CSP (or MAX-CSP) instance I is equivalent to the VCSP instance with 
objective function fi(\x R Ni\) + . . . + f r (\x n N r \). 

Example 5.22. An example of an optimisation problem satisfying the non-overlapping convex property 
is the following office assignment problem. Each of n staff members, represented by n variables, must be 
assigned an office. There are m offices. At most Uj people can be assigned office j. Unary cost functions can 
be used to express personal preferences of each staff member for each office. There are also non-overlapping 
groups of people Gi, . . . , G g who we would prefer to assign to different offices (such as married couples, for 
example) . 

For each office there is a set of (variable,value) assignments Cj consisting of all possible assignments of 
value j to any variable. For each group Gi and for each office j, there is a set of assignments dj C Cj of 
members of this group to office j. Clearly, the sets of assignments Cj (j G {1, . . . , m}) and Cij (i € {1, . . . , g}, 
j G {1, . . . , m}) are all non-overlapping. The function fj which imposes the capacity constraint for office j, 
given by fj(k) = oo if k > Uj (and fj(k) = otherwise), is non- negative, non-decreasing and has a non- 
decreasing derivative. A cost function such as fij(t) = t — 1 (which is non-negative, non-decreasing and 
has a non-decreasing derivative) can be used to code the fact that we prefer that staff members from group 
d do not share the same office. 

Example 5.23. A commonly occurring problem in academia is the allocation of courses to teachers subject to 
timetabling constraints and the personal preferences of the teachers along with a criterion to avoid allocating 
too many hours to any of the teachers. In a simple version of this problem, the weekly timetable has been 
divided up into non-intersecting time-slots, each course involves giving only one lecture a week and one-hour 
time-slots have already been allocated to each course. The courses, numbered from 1 to n, correspond to the 
variables of the problem and must be assigned one of the m teachers. 

For each teacher j G {1, . . . , m}, let Cj represent all assignments of teacher j to any course. For each time- 
slot s G {1, . . . , t} and each teacher j G {1, . . . , m}, let Cj s represent the set of assignments of teacher j to 
courses allocated the time-slot s. Clearly, the sets of assignments Cj (j G {1, . . . , m}) and Cj S (j G {1, . . . , m} 
and s G {1, . . . , t}) are all non-overlapping. For each teacher j, the function fj corresponding to the set of 
assignments Cj and given by fj(k) = max(0,pj(fc — Uj)) (where Uj is the maximum number of courses teacher 
j can give before they have to be paid overtime and pj is the amount teacher j earns per hour of overtime) 
represents the total cost in overtime payments of teacher j. The function fj s , which codes the incompatibility 
of allocating teacher j to two different courses during the same time-slot s, is given by f 8 j(0) = / s j(l) = and 
fj s {k) = oo if k > 1. The functions fj and fij are non-negative, non-decreasing and have a non-decreasing 
derivative. Thus this simple course-allocation problem can be expressed as a VCSP with the non-overlapping 
convex property. 

6 Conclusions 

We have studied hybrid tractability of soft CSPs. In particular, we have studied the tractability of sets of 
instances defined by properties of subproblcms of size k. For k = 2, such properties can only define language 
classes. We have shown in this paper that it is possible to define a non-trivial tractable hybrid class by 
a property on subproblcms of size k — 3. We have studied the tractable class of VCSPs defined by this 
property, known as the joint-winner property (JWP), as a necessary first step towards a general theory of 
tractability of optimisation problems which will eventually cover structural, language and hybrid reasons for 
tractability. Moreover, we have presented several other novel hybrid tractable classes of VCSPs. 
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The JWP is interesting in its own right since it is a proper extension to known tractable classes (such as 
VCSPs consisting of arbitrary unary constraints and non-intersecting SoftAllDiff constraints of arbitrary 
arity, as well as a machine scheduling problem). 

We have demonstrated 3-maximality of the tractable class defined by the JWP. However, the existence 
of a larger tractable class subsuming JWP and defined by a rule on fc-variable subproblems (for k > 3) is 
an interesting open question. Indeed, we have introduced a generalisation of the JWP which is solved by a 
similar algorithm but which allows soft constraints of arbitrary arity. 

The most interesting open question brought out by this work is whether other tractable hybrid classes 
can be defined by properties of /c-variable subproblems for k > 3. 
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